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Preface 


The  purpose  of  this  thesis  was  to  generate  tables  used 
for  the  modified  Kolmogorov-Smirnov  statistic.  These  tables 
are  used  for  testing  whether  a  set  of  observations  is  from  a 
Weibull  (Gamma)  population  when  the  scale  and  location  param¬ 
eters  are  not  specified  but  must  be  estimated  from  the  sam¬ 
ple.  A  brief  Monte  Carlo  investigation  is  made  of  the  power 
of  the  test. 

I  would  like  to  thank  my  advisor,  Capt .  Brian  Woodruff, 
who  offered  me  considerable  guidance  throughout  my  thesis 
project . 

I  would  also  like  to  thank  my  readers,  Lt.  Col.  James 
Dunne  and  Dr.  Albert  H.  Moore,  whose  advise  aided  me  greatly. 
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Abstract 

Its-''  The  Kolmogorov-Smirnov  tables  for  the  Weibull  and  Gamma 
distribution  were  generated  in  this  thesis.  These  tables 
are  used  when  testing  whether  a  set  of  observations  are  from 
a  Weibull  (Gamma)  distribution  in  which  the  location  and 
scale  parameters  must  be  estimated  from  the  sample. 

A  power  investigation  of  the  test  against  some  selected 
distributions  using  Monte  Carlo  techniques  was  conducted. 
This  procedure  shows  that  the  test  is  reasonably  powerful 
for  a  number  of  alternative  distributions. 

A  relationship  between  the  critical  values  and  the 
shape  parameters  was  investigated  for  the  Weibull  and  Gamma 
distributions.  No  apparent  relationship  was  found  for  the 
Gamma  distribution.  In  contrast,  an  approximate  log-linear 
relationship  was  found  for  the  Weibull  when  the  shape  param¬ 


eter  is  between  one  and  four. 


A  MODIFIED  KOLMOGOROV-SMIRNOV 
TEST  FOR  THE  GAMMA  AND  WE I BULL 
DISTRIBUTION  WITH  UNKNOWN 
LOCATION  AND  SCALE  PARAMETERS 


I.  Introduction 


One  of  the  most  important  sets  of  data  generated  by  the 
Air  Force  is  data  dealing  with  the  time  to  failure  of  equip¬ 
ment.  Failure  distributions  are  of  extreme  importance  to  the 
Air  Force  since  they  determine  the  reliability  of  almost  all 
mechanical  systems  in  service. 

Often  these  time-to-failure  data  are  especially  useful 
if  we  can  determine  to  what  theoretical  distribution  they 
correspond.  That  is,  a  test  is  carried  out  to  determine  an 
agreement  between  the  distribution  of  a  set  of  sample  values 
and  a  theoretical  distribution.  This  test  is  known  as  the 
"goodness  of  fit  test."  If  the  frequency  distribution  of  the 
data  compares  well  with  the  expected  or  theoretical  distri¬ 
bution,  we  can  then  use  the  theoretical  distribution  to  rep¬ 
resent  the  parent  or  underlying  population.  Two  very  useful 
theoretical  distributions  that  deal  with  time-to-failure  data 
are  the  Gamma  and  Weibull  distributions. 

Kolmogorov-Smirnov  Test 

The  Kolmogorov-Smirnov  statistic  provides  a  means  of  test¬ 


ing  whether  a  set  of  sample  values  are  from  some  completely 


specified  continuous  theoretical  distribution,  F0(x) 

Suppose  that  a  population  is  thought  to  have  some  specified 
cumulative  distribution  function,  say  F0(x)  .  Then,  for 

any  specified  value  of  x  ,  the  value  of  F0(x)  is  the 
proportion  of  individuals  in  the  population  having  measure¬ 
ments  less  than  or  equal  to  x  .  The  cumulative  step-func¬ 
tion  of  a  random  sample  of  N  observations  is  expected  to 
be  fairly  close  to  this  specified  distribution  function.  If 
it  is  not  ose  enough,  this  is  evidence  that  the  hypothet¬ 
ical  distribution  is  not  the  correct  one. 

If  F0(x)  is  the  population  cumulative  distribution 
and  S^x.^)  tlie  observed  cumulative  step-function  of  a 
sample  (i.e.  ,  where  K  is  the  number  of  obser¬ 

vations  less  than  or  equal  to  x  ),  then  the  sampling 
distribution  of 

D  =  MAX | F o ( x )  -  SQ(x)|  (1) 

is  known,  and  is  independent  of  F0(x)  ,  if  F„(x)  is  con¬ 

tinuous.  A  standard  table  of  the  Kolmogorov- Smirnov  test 
(1:425)  gives  certain  critical  points  of  the  distribution 
of  D  for  various  samples  sizes. 

Chi-Square  vs.  Kolmogorov-Smirnov  Test 

Another  alternative  to  carry  out  the  tests  of  goodness 
of  fit,  especially  useful  in  the  case  where  population  pa¬ 
rameters  must  be  estimated,  is  the  Chi-Square  test  (X2) 
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The  Kolmogorov-Smirnov  test  (K-S),  however,  has  three  major 
advantages  over  the  Chi-Square  (12:68). 

1.  The  K-S  test  can  be  used  with  small  sample  sizes, 
where  the  validity  of  the  Chi-Square  test  would  be  question¬ 
able  . 

2.  Often  the  K-S  test  appears  to  be  a  more  powerful 
test  than  the  Chi-Square  test  for  any  sample  size. 

3.  The  K-S  test  will  usually  require  less  computation 

than  x 2  •  This  is  especially  true  when  a  graphical  test 

is  used,  for  if  the  hypothesis  is  rejected,  the  computation 
stops  at  the  point  of  rejection. 

The  two  major  advantages  the  Chi-Square  has  over  the 
K-S  test  are  (12:68): 

1.  In  cases  where  parameters  must  be  estimated  from 
the  sample,  the  xZ  test  is  easily  modified  by  reducing 
the  number  of  degrees  of  freedom.  The  K-S  test  has  no 
such  known  modification,  so  it  is  not  applicable  in  such 
cases . 

2.  The  K-S  test  cannot  be  applied  to  discrete  popu¬ 
lations,  whereas  x2  can  be. 

Problem 

The  standard  tables  used  for  the  Kolmogorov-Smirnov 
test  are  valid  only  when  testing  whether  a  set  of  observa¬ 
tions  are  from  a  completely  specified  continuous  distribu¬ 
tion.  If  one  or  more  parameters  must  be  estimated  from  the 
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sample  then  the  tables  are  no  longer  valid.  It  has  been 
suggested  by  (12:68)  that  if  the  K-S  test  is  used  in  this 
case,  the  results  will  be  conservative  in  the  sense  that 
the  probability  of  a  type  I  error  will  be  smaller  than  as 
given  by  tables  of  Kolmogorov-Smirnov  statistics.  That  is, 
the  actual  significance  level  would  be  lower  than  that 
given  by  the  standard  tables. 

The  existence  of  the  probability  integral  transforma¬ 
tion  permits  us  to  generate  K-S  type  tables  for  any  partic- 
distribution ,  if  the  parameters  to  be  estimated  are  param¬ 
eters  of  scale  or  location.  David  and  Johnson  (4:182) 
have  shown  that  these  parameters  will  be  completely  inde¬ 
pendent  of  the  distribution  of  any  test  statistic  based  on 
the  cumulative  distribution  function.  The  distribution  of 
the  test  statistic  will,  in  general,  depend  on  the  function¬ 
al  form  of  the  distribution  of  the  original  variables. 

Since  the  K-S  type  test  statistic  is  one  based  on  the  cum¬ 
ulative  distribution  function,  the  results  of  David  and 
Johnson  apply  in  this  case. 

Background 

Tables  for  the  Kolmogorov-Smirnov  test  when  population 
parameters  are  unknown  have  been  generated  by  Hubert  W. 
Lilliefors  at  the  George  Washington  University.  He  gener¬ 
ated  the  tables  for  the  Normal  distribution  (8:399)  and  the 
Exponential  distribution  (9:387). 
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Objectives 

This  thesis  has  the  following  objectives: 

1.  To  generate  and  present  the  Kolmogorov-Smirnov 
tables  for  the  Weibull  and  Gamma  distribution  when  the  scale 
and  location  parameters  are  not  specified. 

2.  To  determine  the  power  of  the  test  in  selected 
situations  using  a  Monte  Carlo  investigation. 

3.  To  investigate  the  relationship  between  the  criti¬ 
cal  values  and  the  shape  parameter  for  the  Weibull  and  Gamma 
distributions. 
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II.  The  Distributions 


Weibull  Distribution 

Historical  Notes.  The  Weibull  distribution  is  named 
after  the  Swedish  scientist  Waloddi  Weibull,  who  published 
a  paper  in  1939  (10:50)  giving  some  of  the  distribution's 
uses  for  an  analysis  of  the  breaking  strengths  of  solids. 
However,  it  was  also  known  to  R.A.  Fisher  and  L.H.C.  Tippett 
who  published  a  paper  in  1928. 

Application  of  the  Weibull  Distribution.  In  the  past 
ten  to  fifteen  years  the  Weibull  distribution  has  emerged 
as  the  one  popular  parametric  family  of  failure  distribu¬ 
tions.  Its  applicability  to  a  wide  variety  of  failure  sit¬ 
uations  was  discussed  by  Weibull.  For  example,  it  has  been 
used  to  describe  vacuum-tube  and  ball-bearing  failures. 

The  Weibull  distribution  is  closely  related  to  the  ex¬ 
ponential,  but  has  two  additional  parameters,  the  shape 
parameter  and  the  location  parameter.  Thus,  instead  of  a 
single  constant  failure  rate  A  ,  as  in  the  exponential 
case,  a  variety  of  hazard  situations  can  be  treated.  For 
a  given  Weibull  distribution,  the  failure  rate  can  be 
either  continually  increasing,  continually  decreasing,  or 
else  constant.  Since  many  failures  encountered  in  practice, 
especially  those  pertaining  to  nonelectric  parts,  show  an 
increasing  failure  rate  (due  to  deterioration  or  wear)  the 
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Weibull  distribution  is  useful  in  describing  failure  pat¬ 
tern  of  this  type. 

The  Weibull  Probability  Function.  Let  the  random  var¬ 
iable  x  denote  testing  or  operating  time,  and  let  n  de¬ 
note  the  "scale"  parameter,  3  the  "shape"  parameter,  and 
Y  the  "location"  parameter.  The  Weibull  probability  den¬ 
sity  function  (p.d.f.)  is 


f(x|n,S,Y) 


8(x-y) 


3-1 


.3 


exp 


(2) 


The  Weibull  distribution  function  is 


F(x) 


f  ( x  |  n  ,  3 ,  y ) 


=  l 


exp 


(3) 


When  8=1  the  Weibull  distribution  specializes  to  the 
exponential  distribution,  and  when  8=2  the  resulting  dis¬ 
tribution  is  known  as  the  Rayleigh  distribution.  The  mean 
and  variance  of  the  Weibull  are  given  as  follows: 


Mean  =  Y+nr(^r^) 


(4) 
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A  Weibull  distribution  with  y»0  and  n=l  is  illus¬ 
trated  for  different  values  of  the  shape  parameter  3  in 
Figure  1. 


Gamma  Distribution 

Historical  Notes.  The  Gamma  distribution  is  a  natural 
extension  of  the  exponential  distribution  and  has  sometimes 
been  considered  as  a  model  in  life-test  problems.  It  can 
be  derived  by  considering  the  time  to  the  K1"  success  in 
a  Poisson  process  or,  equivalently,  by  considering  the  K 
fold  convolution  (10:55)  of  an  exponential  distribution. 


S 


The  Gamma  distribution  is  the  continuous  analog  of  the 
negative  binomial  distribution  (11:125)  which  can  also  be 
obtained  by  considering  the  sum  of  K  variables  with  a 
common  geometric  distribution. 

Applications  of  the  Gamma  Distribution.  The  Gamma 
Distribution  has  been  used  widely  in  queueing  systems.  For 
example,  it  has  been  used  to  determine  the  lengths  of  time 
between  malfunctions  for  aircraft  engine  and  the  lengths  of 
time  between  arrivals  at  a  bank,  super  market,  or  mainten¬ 
ance  checkout  queue. 

The  Gamma  distribution  is  one  of  the  most  useful  con¬ 
tinuous  distributions  available  to  the  simulation  analyst. 
If  the  variables  from  some  random  phenomenon  cannot  assume 
negative  values  and  generally  follow  a  unimodal  distribu¬ 
tion,  then  the  chances  are  excellent  that  a  member  of  the 
gamma  family  can  adequately  model  the  phenomenon.  The 
Gamma  distribution  is  defined  by  three  parameters,  9  , 
a  and  c  ,  where  9  is  the  "scale"  parameter,  a  is 
the  "shape"  parameter  and  c  is  the  "location"  parameter. 
The  Gamma  probability  density  function  (p.d.f.)  is 


f  (  x  |  c ,  9  ,  a ) 


,  .  a-1 

(x-c) 

T  ( a  )9  a 


(6) 


9  ,  a>0 


x>c£0 


The  Gamma  distribution  function  is 

x 

F(x)  =  f f(x|c,6,a)  (7) 

J0 

This  integral  does  not  have  a  closed  form  expression. 
Its  values  have  to  be  determined  by  numerical  calculations. 
When  a=l  ,  c=0  the  Gamma  density  is  the  exponential 

density  function  with  an  expected  value  of  0  .  If  a 

is  an  integer  value,  K  ,  then  the  Gamma  distribution  is 
commonly  referred  to  as  an  Erlang-K  distribution.  Further¬ 
more,  if  0=1  ,  then  as  a  becomes  large,  the  Gamma  dis¬ 

tribution  approaches  the  normal  distribution.  If  we  set 
a=v/2  and  0=2  (where  v  is  the  degrees  of  freedom)  we 
get  the  Chi-Square  distribution.  The  mean  and  variance  of 
the  Gamma  are  given  as  follows: 


Mean  =  a0+c 

(8) 

Variance  =  a02 

(9) 

A  Gamma  distribution  with  c=0  and  0=1  is  illus¬ 
trated  for  different  values  of  the  shape  parameters  a  in 
Figure  1. 
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Ill .  Methodology 


The  method  that  follows  was  the  one  used  in  calculating 
critical  values  for  the  modified  D  statistic  when  the 
scale  and  location  parameter  are  not  specified. 

For  a  fixed  sample  size  n  ,  random  deviates  x(iy 
x(2)‘“'x(n)  were  generated  from  the  Weibull  and  Gamma  dis¬ 
tributions.  Next  the  random  sample  x^^  »x(2 )  •  *  ,x(n)  was 
used  to  estimate  the  scale  and  location  parameter  by  the 
method  of  maximum- likelihood.  The  resulting  estimates  of 
the  scale  and  location  parameter  and  the  constant  value  of 
the  shape  parameter  are  then  used  to  determine  F0(x),  the 
hypothesized  distribution  function.  Finally,  D=max|F0(x)- 
Sn(x)|  was  calculated  for  the  sample  size  n  .  This  pro¬ 
cedure  was  repeated  1000  times,  thus  generating  1000  inde¬ 
pendent  values  of  the  D  statistics.  These  1000  values 
were  then  ranked,  and  the  80th,  85th,  90th,  95th  and  99th 
percentiles  were  found.  This  entire  process  was  performed 
for  sample  sizes  from  n=4  to  30  . 

After  tables  for  the  test  procedure  were  completed,  a 
power  comparison  was  conducted. 

What  follows  is  a  more  detailed  description  of  the 
steps  taken  in  this  procedure.  Figure  2  illustrates  this 
procedure . 
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Generati ng 
Random  Variates 
from  Gamma  (Wei bul 1 ) 
Distribution 


Qetermi ni ng 
the  scale  &  location 
parameters  by 
Method  of  Maximum 
1 i k  e 1 i hood 


Obtai ni ng 


Generation  of  Random  Weibull  Deviates 

The  Weibull  pseudo-random  deviates  were  generated  by 

1 

x  =  i -In  (u)|&  (10) 

where  u  is  a  pseudo-random  deviate  from  a  uniform  (0,1) 
distribution  and  8  is  the  shape  parameter.  These  deviates 
were  obtained  on  the  CDC  6600  computer  by  using  the  Inter¬ 
national  Mathematical  and  Statistics  Library  (IMSL)  sub¬ 
routine  GGWIB  (19:306). 

Generation  of  Random  Gamma  Deviates 

The  Gamma  pseudo-random  deviates  were  generated  using 
rejection  methods  by  various  computational  algorithms  de¬ 
pending  on  the  value  of  the  shape  parameter  a  .  These 
algorithms  are  contained  in  the  IMSL  subroutine  GGAMR 
(14:1541).  This  subroutine  was  used  to  obtain  the  Gamma 
deviates  on  the  CDC  6600  computer. 

Maximum  Likelihood  Estimation  of 
Weibull  and  Gamma  Parameters 

The  procedure  used  to  derive  the  maximum  likelihood  es- 

A  A  A 

timates,  n  ,  6  and  y  ,  of  the  Weibull  parameters,  n  , 

A  A  A 

3  and  y  ,  and  0  ,  a  and  c  ,  of  the  Gamma  parameters, 
0  ,  ot  and  c  ,  was  developed  by  Harter  and  Moore  (7:639). 
They  developed  an  iterative  procedure  for  censored  or  un¬ 
censored  samples  for  the  three  parameter  Weibull  and  Gamma 


distribution.  For  each  of  these  distributions,  the  likeli¬ 
hood  function  is  written  down,  and  the  three  maximum-likeli¬ 
hood  equations  are  obtained.  In  each  case,  simultaneous 
solution  of  these  three  equations  would  yield  joint  maxi¬ 
mum-likelihood  estimators  for  the  three  parameters.  The 
iterative  procedures  proposed  to  solve  the  equations  are 
applicable  in  the  most  general  case,  in  which  all  three 
parameters  are  unknown,  and  also  to  special  cases  in  which 
any  one  or  any  two  of  the  parameters  are  unknown. 

Weibull  Maximum  Likelihood  Estimates 

The  probability  density  function  of  the  random  vari¬ 
able  x  having  a  Weibull  distribution  with  location  param¬ 
eter  y-0  ,  scale  parameter  n  ,  and  shape  parameter  B 

is  given  by 

f ( x |  n,S,y)  =  ( )exp(-(^)S) 

n,6>0,  x-y >0  (11) 

The  natural  logarithm  of  the  likelihood  function  of  the 
order  statistics  x1 ,  x_,...,x  ,  of  a  sample  of  size  n  is 
given  by  (7:640) 

n 

L  =  In  n!+n(ln  8-g  In  n)  +  (S-l)  In  (x^y) 

c=l 

n 

-  ^  (x1-y)/n  6  (12) 

c=l 
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The  maximum-likelihood  equations  are  obtained  by  equat¬ 


ing  to  zero  the  partial  derivatives  of  L  with  respect  to 
each  of  the  three  parameters;  these  partial  derivatives  are 
given  by: 


3L 

3n 


£  (-fO'rt'*1 


i=l 


(13) 


n  n 

H  =  23  In  (xi  -Y)~y3^xi  -Y)/h]  e  In  [(x..-Y)nJ  (14) 

i=l  i=l 


(l-6)23(xi-Y)'1+fin‘623(xi-Y)B_1 
i=l  i=l 


(15) 


Gamma  Maximum  Likelihood  Estimates 

The  probability  density  function  of  the  random  vari¬ 
able  x  having  a  Gamma  distribution  with  location  param¬ 
eter  c-0  ,  scale  parameter  0  ,  and  shape  parameter  a 

is  given  by 

f ( x , c , 0 , a )  =  [l/r(a)9]  [(x-c)/6] a-1*exp[-(x-c)/9j 

0 , a>0  x-c^O  (16) 

The  natural  logarithm  of  the  likelihood  function  of  the 
order  statistics  xi'x2'**,xn  of  a  sample  of  size  n  is 
given  by 
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L  =  In  n!-n  In  T(a)-na  In  9+(a-l) 


n  n 

•  ^^ln  (xi-c)-  (x^cj/g  (17) 

i=l  i=l 


The  maximum- likelihood  equations  are  obtained  by  equat¬ 
ing  to  zero  the  partial  derivatives  of  L  with  respect  to 
each  of  the  three  parameters;  these  partial  derivatives  are 
given  by 

n 

||  =  -na/0  +  (xfc)92  (18) 

i=l 


n 

||  *  -n  In  e+y;  ln  (xi-c)-nr'(a)/F(a) 
i=l 


(19) 


n 

■||  =  (l-u)^^(xi-c)"1+n/9  (20) 

i=l 

3L 

where  the  prime  in  indicates  differentiation  with  re- 

3a 

spect  to  a 

Calculation  of  Test  Statistic  D 

For  the  Weibull  distribution  there  was  no  problem  in 
calculating  D  in  Eq(l)  since  F0(x)  has  a  closed  form  ex¬ 
pression  Eq.(3).  Since  the  Gamma  distribution  does  not  have 
a  closed  form  expression,  an  integral  calculation  had  to  be 
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done  in  order  to  determine  F0(x)  before  calculating  D 
This  integral  calculation  was  accomplished  using  the  IMSL 
subroutine  MDGAM  (16:946)  which  evaluates  the  probability 
that  a  random  variable  from  a  Gamma  distribution  having 
shape  parameter  at  with  c=0  and  0=1  is  less  than  or 
equal  to  x 


f  e~tta'1- 

“  J  ~  hjfi 


In  order  to  use  this  subroutine,  the  generalized  three 
parameter  Gamma  density  function  considered  in  this  thesis 
had  to  be  transformed  to  the  one  parameter  Gamma  density 
function  used  in  the  subroutine.  This  transformation  was 
done  as  follows: 


F(y)  -  f-is=sl 
„  r(cOea 


i  /.X-C. 

0-1  -(-Q-) 

e  9  dx 


Let,  z=x-c  dz=dx. 
Then ,  x=c-*-z=0 


x=y-*z=y-c 


y-c  .  -z 
r  _o-l 


f  z^1 

<  r(a)0a 


e&  dz 


Next,  let  t*^  »  dt ~g~ 


•  s 


Then  z=0-*-t=0 


z=y — c~*"t 


_y-c 

9 


and 


F(y) 


dt 


(24) 


which  is  the  same  integral  in  Eq(21)  with  x~— Qc 

U 

Power  Comparison 

The  power  of  the  test  using  the  modified  D  statistic 
was  compared  for  four  alternative  distributions.  These 
power  comparisons  were  made  using  Monte  Carlo  simulation. 

The  procedure  is  very  similar  to  the  procedure  used  in  creat¬ 
ing  the  critical  values  for  the  D  statistic.  Five  thou¬ 
sand  random  samples  of  size  n  were  generated  for  each  of 
the  four  alternative  distributions  considered.  Then  the  D 
statistic  was  calculated  and  compared  to  its  respective  cri¬ 
tical  value  obtained  from  the  table  generated.  The  number 
of  rejections  of  the  two  different  null  hypotheses  (that 
the  distribution  was  from  a  Weibull  or  Gamma  distribution 
with  known  shape  parameter)  were  counted. 


Analysis  of  Critical  Values  vs.  Shape  Parameter 

The  tables  generated  in  this  thesis  for  the  Weibull 
and  Gamma  distributions  will  depend  on  the  value  of  the  shape 
parameter.  For  different  values  of  the  shape  parameter  we 
will  have  different  tables.  For  this  reason  we 
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have  presented  tables  for  eight  different  shape  parameters. 
These  shape  parameters  are  .5,  1.0,  1.5,  2.0,  2.5,  3.0,  3.5, 
4.0  . 

Since  there  is  an  apparent  relationship  between  the 
shape  parameter  and  the  table's  critical  values, an  investi¬ 
gation  of  the  possibility  of  finding  an  expression  or  equa¬ 
tion  that  indicates  the  relationship  between  the  shape 
parameter  and  the  critical  values  was  conducted.  Both  re¬ 
gression  and  graphical  methods  were  considered. 

Computer  Programs 

The  computer  programs  built  for  generating  the  Gamma 
and  Weibull  distribution  were  made  very  flexible.  That  is 
they  were  built  to  generate  tables  for  any  shape  parameter 
input  into  the  programs.  The  programs  used  to  generate  the 
Gamma  and  Weibull  distributions  are  presented  in  Appendix  D. 


IV.  Use  of  Tables 


In  the  Kolmogorov  Smirnov  test  a  theoretical  or  as¬ 
sumed  distribution  F(x),  is  compared  to  an  observed 
distribution  Sn(x)  •  If  the  maximum  deviation  of 
|F(x)-Sn(x)|  exceeds  a  certain  limiting  value  ,  d^  n 
the  assumed  distribution  is  rejected. 

The  steps  in  applying  the  modified  Kolmogorov  Smir¬ 
nov  test  when  the  scale  and  location  parameters  are  es¬ 
timated  are  as  follows: 

1.  Determine  the  values  of  the  scale  and  location 
parameters  by  one  of  the  methods  of  parameter  estimation. 

2.  Specify  completely  (including  the  shape  param¬ 
eter)  the  hypothesized  distribution  F(x) 

3.  Determine  the  desired  level  of  significance,  a  , 
and  the  desired  or  planned  sample  size,  n  .  The  level  of 
significance,  a  ,  is  the  risk  of  rejecting  the  hypothe¬ 
sized  distribution  if  it  is  in  fact  the  true  distribution. 

4.  Using  the  tables  generated  in  this  thesis,  select 
the  critical  value,  d 

a ,  n 

5.  Select  a  random  sample  of  n  items  from  the  pop¬ 
ulation  to  be  tested,  and  order  the  observations. 

6.  Determine  the  maximum  value,  d  ,  of 

D  =  |F0(x)-Sn(x)| 
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where 


S  =  i/n  when  x.-x<x.,- 
n  1  i+l 

7.  If  d>d  reject  the  hypothesized  distribution. 
a,n 

If  d-d  the  hypothesized  distribution  cannot  be  re- 
01  ,  n 

jected  and  we  say  that  it  is  reasonable  to  assume  that  the 
hypothesized  distribution  is  the  true  distribution. 

These  steps  are  illustrated  in  the  two  examples  which 
follow. 

Example  for  the  Weibull  Distribution 

A  certain  engineer  is  involved  with  the  development  of 

a  new  turbojet  engine.  It  is  important  to  determine  the 

failure  time  of  this  new  engine  before  it  is  introduced  to 

the  market.  Six  identical  engines  were  tested.  The  failure 

time  data  obtained  from  these  tests  were: 

.034,  .168,  .266,  .563,  1.344,  3.118  years. 

The  engineer  believes  that  the  failure  time  of  this  engine 

follows  a  Weibull  distribution  with  shape  parameter  equal 

to  one  and  scale  and  location  parameter  undetermined.  We 

will  now  conduct  the  test  developed  in  this  thesis  at  the 

5%  level  of  significance  to  determine  if  the  engineer's 

hypothesis  is  reasonable.  That  is, 

Hq:  The  distribution  is  Weibull  (shape=l) 

H  :  Another  distribution 
a 

First  we  determine  the  scale  and  location  parameter  by 
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TABLE  I 


■ 

X. 

l 

F(x.) 

S  (x.  ) 
n  l ' 

I F( x . )-S  (x. ) I 

1  nv  i ' 

|F<xi,-Sn(xi-l)1 

1 

.034 

.036 

.167 

.  131 

.036 

2 

.168 

.  166 

.334 

.168 

.001 

3 

.266 

.250 

.501 

* . 251* 

.084 

4 

.563 

.457 

.668 

.211 

.044 

5 

1.344 

.767 

.835 

.068 

.099 

6 

3.118 

.966 

1.000 

.034 

.131 

Note  that 

i=max| F(x)-Sn(x)  | 

is  .251. 

the  method  of  maximum  likelihood.  The  following  values 

A 

were  obtained:  scale  =  n  -.923  location  =  a  =  .0003 

Using  these  estimates  and  6=1  ,  in  Eq(3)  we  can  obtain 

values  for  the  hypothesized  distribution.  We  can  then  con¬ 
struct  Table  I.  Using  the  table  of  critical  values  for  the 
Weibull  distribution  for  shape=l  we  find  for  ot=.05  and 

n=6  that  d  -  =.383  .  Hence,  since  .251<.383,  we  can- 
.05,6 

not  reject  the  null  hypothesis.  We  conclude  that  a  Weibull 
distribution  with  shape  parameter  equal  to  one  is  a  reason¬ 
able  model  for  the  engine  failure  data. 

Example  of  the  Gamma  Distribution 

Major  Smith  is  the  maintenance  squadron  commander  at 
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Big  AFB.  During  the  past  six  months  he  has  been  trying  to 
determine  the  lengths  of  time  his  crew  takes  to  complete  a 
maintenance  service  for  an  aircraft  engine.  This  informa¬ 
tion  is  vital  to  him  since  it  will  permit  him  to  schedule 
his  crew  in  a  way  that  will  optimize  service  time.  Major 
Smith,  presented  this  problem  to  Lt  Jones.  Lt  Jones  gath¬ 
ered  the  following  service  time  data: 

.397,  .524,  .691,  .973,  2.548,  2.933  hours. 

Lt  Jones  told  Major  Smith  that  he  believes  that  these  data 
follow  a  Gamma  distribution  with  shape  parameter  equal  to 
one.  Major  Smith  wants  to  use  the  test  procedures  of  this 
thesis  at  the  5%  level  of  significance  to  determine  if  Lt 
Jones'  hypothesis  is  reasonable.  That  is, 

Hq:  The  distribution  is  Gamma  (shape=l) 

H  :  Another  distribution 
a 

First  we  determine  the  scale  and  location  parameter  by 
the  method  of  maximum  likelihood.  The  following  values 

/v  * 

were  obtained:  scale  *  0  =  1.009  location  =  c  =  .341 
Using  these  estimates,  and  ct=l,  in  Eq(24),  we  can  obtain 
values  for  the  hypothesized  distribution  function.  We  can 
then  construct  Table  II.  Using  the  table  of  critical  val¬ 
ues  for  the  Gamma  distribution  for  shape=l  we  find  for  level 

a= . 05  and  n=6  that  d  -.383  .  Hence,  since  ,220<.383, 

.05,6 

we  cannot  reject  the  null  hypothesis.  We  conclude  that  a 
Gamma  distribution  with  shape  parameter  equal  to  1  is  a 
reasonable  model  for  the  length  of  time  of  a  maintenance 


service . 
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TABLE  II 


B 

Xi 

F(x.) 

W 

BB 

lF<Xl)-Sn(x1-l,l 

B 

.  397 

.054 

.  167 

.113 

.054 

□ 

.524 

.167 

.334 

.167 

.000 

B 

.691 

.293 

.501 

.208 

.041 

B 

.973 

.466 

.668 

.202 

.035 

5 

2.548 

.888 

.835 

.053 

*.220* 

6 

2.933 

.923 

1.000 

.077 

.088 

Note 

that 

d=max| F(x)-Sn(x) 

is  .220. 

V.  Discussion  of  Results 


The  results  obtained  in  this  thesis  are  discussed  in 
this  chapter.  Results  applicable  to  each  objective  are 
presented  in  the  sequence  in  which  the  objectives  were  pre¬ 
sented  in  Chapter  I.  All  tables  referenced  in  this  chapter 
are  located  in  Appendix  A  and  B,  and  all  figures  in  Appen¬ 
dix  C. 

Presentation  of  the  Kolmogorov-Smirnov  Tables 

The  Kolmogorov-Smirnov  tables  for  the  Weibull  and 
Gamma  distribution  when  the  scale  and  location  parameters 
are  not  specified  are  presented  in  Appendix  A  and  B  respec¬ 
tively.  The  critical  values  in  these  tables  were  subject 
to  simulation  variability.  This  variability  was  reflected 
in  the  third  decimal  place  of  the  critical  values.  Due  to 
this  variability  the  critical  values  in  many  tables  are  not 
monotonically  decreasing  functions  of  sample  size  when  the 
sample  size  exceeds  15. 

This  variability  is  not  unusual  for  any  kind  of  Monte 
Carlo  simulation.  There  are  several  methods  which  can  be 
used  to  eliminate  this  variability.  One  method  is  to  in¬ 
crease  the  simulation  sample  size.  In  this  thesis  the 
critical  values  were  obtained  with  1000  samples.  If  the  sim¬ 
ulation  would  have  been  done  with  more  than  1000  samples,  the 
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variability  would  have  been  less.  For  example  Table 
(Ref.  Appendix  B)  was  obtained  with  5,000  samples  and  as 
can  be  seen  the  simulation  variability  has  been  reduced. 

The  critical  values  are  monotonically  decreasing  for  in¬ 
creasing  sample  sizes  at  all  levels  of  significance.  All 
the  tables  were  not  generated  with  5,000  samples  because  to 
do  so  would  require  a  large  amount  of  computer  time.  Anoth¬ 
er  method  to  reduce  simulation  variability  is  to  run  the  pro¬ 
gram  with  a  different  seed  several  times  with  a  relatively 
small  number  of  samples  in  each  run.  Then  the  critical  val¬ 
ues  are  obtained  by  computing  the  means  of  the  critical  val¬ 
ues  found  on  these  several  runs.  For  example,  the  programs 
used  in  calculating  the  tables  in  this  thesis  (1000  samples) 
could  have  been  run  five  times  with  a  different  seed  every- 
time.  Then  the  critical  values  would  have  been  obtained  by 
computing  the  mean  of  the  five  program  runs.  Again  this 
procedure  was  not  carried  out  because  it,  too,  would  require 
a  large  amount  of  computer  time. 

Validity  of  Computer  Programs 

The  validity  of  the  computer  programs  (Appendix  D)  used 
to  generate  the  tables  presented  in  this  thesis  were  verified 
by  comparing  the  critical  values  obtained  with  the  computer 
programs  with  the  critical  values  obtained  by  Lilliefors  in 
his  exponential  table  (9:387).  This  comparison  is  possible 
because  both  the  Weibull  and  Gamma  distributions  become  an 
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exponential  distribution  when  the  shape  parameter  is  one 
and  the  location  parameter  is  zero.  When  the  shape  param¬ 
eter  was  input  to  one,  the  location  parameter  to  zero  and 
the  scale  parameter  set  to  be  estimated  in  the  computer 
programs  the  critical  values  obtained  were  almost  identi¬ 
cal  to  the  critical  values  obtained  by  Lilliefors  in  his 
exponential  table.  These  results  can  be  seen  in  Table  III 
for  sample  size  n=10 

Power  of  the  Test 

The  power  of  the  test  was  carried  out  as  discussed  in 
Chapter  III  with  only  one  exception.  The  Monte  Carlo  sim¬ 
ulation  for  the  power  of  the  test  for  the  Gamma  distribution 
was  obtained  with  2000  samples  of  size  n=30  instead  of  the 
5,000  samples  indicated  in  Chapter  III.  The  reason  for  this 
change  was  the  excessive  amount  of  computer  time  required  to 
do  the  test  with  5,000  samples. 

The  results  obtained  are  presented  in  Table  IV  and  V. 
Table  IV  represents  the  probability  of  rejecting  the  null 
hypothesis  of  a  Weibull  distribution  with  shape  parameter 
one  using  the  modified  D  statistic  of  this  thesis  when 
the  sample  size  is  30.  The  numbers  are  the  result  of  Monte 
Carlo  simulation  with  5,000  samples  for  each  distribution. 
Table  V  represents  the  probability  of  rejecting  the  null 
hypothesis  of  a  Gamma  distribution  with  shape  parameter  one 
using  the  modified  D  statistic  when  the  sample  size  is  30. 
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TABLE  III 


Comparison  Between  Thesis  Program  Critical  Values 

and  Lilliefors  Critical  Values 

Level  of 
Significance 

.20 

.15 

.10 

— 

.05 

.01 

Critical  Values 
Obtain  by 

Li  1 1 iefors 

.263 

.277 

.295 

.325 

.38 

Critical  Values 
Obtain  by 

Thesis  Programs 

.265 

.279 

.301 

.323 

.381 

TABLE  IV 

Power  of  the  Test  for  the  Weibull 


Modified  K-S  test  for  the  Weibull 
distribution 


Using  critical  values  from  Table  23 


<*.=  .01 


og  normal 
amma ( shape=l ) 
amma ( shape  =  2 ) 
ei  bull ( shape  =  2 ) 


Pi  U  2 


,007  .013 
,933  .947 
,850  .870 

.169  .191 
,007  .013 
.248  .272 
.007  .013 


■ 


The  numbers  are  the  result  of  Monte  Carlo  simulation  with 
2,000  samples  for  each  distribution. 

In  both  Tables  IV  and  V,  Uj  and  U2  represent  the 
lower  and  upper  limit  of  the  95%  confidence  interval  for  the 
probability  of  rejecting  the  null  hypothesis.  This  confi¬ 
dence  interval  is  given  by: 

P^-Za,2^^Za/2^J¥  *  P"J‘<e<C=> 

/\ 

where  p  is  the  proportion  of  rejections  in  the  computer 
runs  and  ^a/2  is  uPPer  ot/2  cut-off  value  from  a 
standard  normal. 

Table  IV  indicates  that  when  the  null  hypothesis  is 
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true,  the  test  does  in  fact  achieve  the  claimed  significance 
level.  The  test  has  a  very  high  power  when  used  on  Beta  and 
Normal  distributions,  but  not  so  high  for  the  log  normal  dis¬ 
tribution.  The  results  obtained  for  the  Gamma  distribution 
with  shape  parameter  equal  to  one  were  the  same  as  those  for 
the  Weibull  with  shape  equal  to  one.  This  result  was  expect¬ 
ed  since  both  distributions  are  an  exponential  distribution 
under  this  condition.  In  contrast,  when  the  test  was  done 
with  a  Gamma  distribution  with  shape  parameter  equal  to  two 
different  results  were  obtained.  This  demonstrates  that  the 
test  does  reasonably  well  against  the  Gamma  distribution 
with  shape  parameter  not  equal  to  one.  In  contrast,  the 
test  is  not  very  powerful  against  a  Weibull  with  shape  par¬ 
ameter  equal  to  two.  This  suggests  that  the  test  may  not  be 
able  to  readily  distinguish  between  different  members  of  the 
Weibull  family. 

Table  V  indicates  that  when  the  null  hypothesis  is  true, 
the  test  approximates  reasonably  well  the  claimed  ,05  signi¬ 
ficance  level  and  exactly  the  .01  significance  level.  The 
test  has  a  reasonably  good  power  when  used  on  Beta  and  Nor¬ 
mal  distributions,  but  no  so  good  for  the  log  normal  distri¬ 
bution.  The  results  obtained  for  the  Weibull  distribution 
with  shape  parameter  equal  to  one  were  the  same  as  those  for 
the  Gamma  with  shape  equal  to  one.  This  result  was  expect¬ 
ed  since  both  distributions  are  an  exponential  distribution 
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under  this  condition.  In  contrast,  when  the  test  was  done 
with  a  Weibull  distribution  with  shape  parameter  equal  to 
two,  different  results  were  obtained.  Unfortunately,  the 
results  obtained  for  the  Weibull  distribution  with  shape 
parameter  equal  to  two  were  poor.  They  indicate  that  the 
test  could  not  distinguish  between  a  sample  generated  from 
a  Gamma  distribution  with  shape  parameter  equal  to  one  to 
a  sample  from  a  Weibull  distribution  with  a  shape  parameter 
equal  to  two. 

In  general,  the  results  obtained  for  the  power  of  the 
test  for  the  Gamma  distribution  were  poor  in  comparison  to 
the  results  obtained  for  the  Weibull  distribution  even 
though  the  null  hypothesis  in  each  table  was  the  exponen¬ 
tial  distribution. 

Three  possible  factors  could  have  caused  these  differ¬ 
ent  results  for  the  Gamma. 

1)  The  critical  values  used  in  the  Gamma  test  were 
generated  with  2,000  samples  while  the  critical  values  used 
in  the  Weibull  distribution  test  were  generated  with  5,000 
samples.  This  implies  that  the  critical  values  for  the 
Gamma  distribution  had  more  Monte  Carlo  variability  than 
those  for  the  Weibull  distribution. 

2)  The  power  of  the  test  for  the  Gamma  distribution 
was  conducted  with  2,000  samples  while  the  test  for  the 
Weibull  distribution  was  done  with  5,000  samples. 


31 


3)  The  cumulative  distribution  function  for  the  Gamma 
was  determined  by  an  integral  calculation.  This  integral 
calculation  is  subject  to  errors  since  the  values  obtained 
will  be  limited  by  some  tolerance.  For  the  Weibull  distri¬ 
bution  such  a  problem  does  not  exist  since  its  cumulative 
distribution  function  has  a  closed  form. 


Relationship  Between  Critical  Values  and  Shape  Parameter 


As  discussed  in  Chapter  III  a  relationship  between  the 
critical  values  and  the  shape  parameter  was  investigated. 

For  the  Gamma  distribution  no  apparent  relationship  was 
found  as  can  be  seen  in  Figures  three  through  17.  Possibly 
by  increasing  the  number  of  shape  parameters  in  the  inves¬ 
tigation  a  relationship  could  be  found.  Another  possible 
explanation  for  the  apparent  lack  of  a  relationship  is  Monte 
Carlo  variability  in  the  critical  values.  Increasing  the 
number  of  samples  used  to  generate  the  critical  values  for 
the  Gamma  distribution  may  reduce  the  variability  sufficient¬ 
ly  to  enable  a  relationship  to  be  found. 

For  the  Weibull  distribution  an  approximate  relation¬ 
ship  was  found  when  the  shape  parameter  is  greater  than  one 
as  can  be  seen  in  Figures  18  through  32.  The  approximated 
equation  found  to  represent  the  relationship  between  the 
critical  values  and  the  shape  parameter  (between  one  and  four) 


In  y  =  ao  +  aix 
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where  ao  is  a  constant,  and  ai  is  the  coefficient  of 
the  independent  variable.  The  variable  x  is  the  indepen¬ 
dent  variable  which  is  the  shape  parameter,  and  In  y  rep¬ 
resents  the  natural  logarithm  of  the  critical  value. 

This  equation  was  the  best  expression  found  to  repre¬ 
sent  the  relationship  between  the  critical  values  and  the 
shape  parameter  between  one  and  four. 

The  equations  obtained  for  all  levels  of  significance 
using  three  different  sample  sizes  are  presented  in  Table 
VI. 

The  R2  value  on  the  table  indicates  how  good  the  log- 
linear  equation  represents  the  relationship  between  the  cri¬ 
tical  values  and  the  shape  parameter.  From  these  values  we 
can  see  that  with  the  exception  of  sample  size  15  at  level 
of  significance  .01  all  R2  values  are  greater  than  .85  . 
This  indicates  that  the  log-linear  equation  is  a  good  approx¬ 
imation  for  the  relationship.  For  example,  sample  size  15  at 
level  .20  had  Rz=.95,  and  sample  size  15  at  level  .15  had 
R2=. 96  .  In  fact,  of  the  15  regressions  done,  10  had  an  R2 
equal  to  or  greater  than  .90.  From  these  results  it  can  be 
concluded  that  the  log-linear  equation  is  a  good  approxima¬ 
tion  for  the  relationship,  but  not  an  exact  one. 

The  values  presented  in  Table  VI  were  calculated  using 
the  Statistical  Package  for  the  Social  Sciences  (SPSS) ( 17 : 11) . 
These  equations  can  be  used  to  obtain  approximate  critical 
values  for  Weibull  distributions  with  any  shape  parameter  be¬ 


tween  one  and  four. 
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VI.  Conclusions  and  Recommendations 


Conclusions 

On  the  basis  of  the  results  obtained  in  this  thesis 
the  following  conclusions  are  drawn. 

1.  The  tables  generated  for  the  modified  Kolmogorov- 
Smirnov  are  valid.  Monte  Carlo  studies  have  shown  that  the 
test  achieved  the  claimed  significance  level  when  the  null 
hypothesis  is  true  and  have  good  power  against  several  al¬ 
ternative  distributions. 

2.  A  log-linear  relationship  between  the  critical 
values  and  the  shape  parameter  was  found  for  the  Weibull 
distribution  when  the  shape  parameter  is  greater  than  one. 

In  contrast,  there  seems  to  be  no  simple  linear  type  rela¬ 
tionship  for  the  Gamma  distribution. 

Recommendations  for  Further  Study 

Based  on  the  observations  made  during  this  investiga¬ 
tion,  the  following  recommendations  are  proposed  for  further 
study : 

1)  To  increase  the  number  of  shape  parameters  used  in  the 
investigation  of  the  Weibull  (Gamma)  distribution  to  see  if 
a  better  expression  can  be  obtained  for  the  relationship  be¬ 
tween  critical  values  and  shape  parameters. 

2)  To  increase  the  range  of  shape  parameters  investigated 
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for  tbe  Gamma  distribution  to  see  if  an  expression  or  equa¬ 
tion  could  be  found. 

3)  To  increase  the  range  of  shape  parameters  investigated 
for  the  Weibull  distribution  to  see  if  the  log-linear  re¬ 
lationship  between  shape  parameters  and  critical  values  re¬ 
mains  valid  for  shape  parameter  greater  than  four. 

4)  To  compare  the  power  of  the  test  between  the  Chi-square 
and  the  modified  Kolmogorov-Smirnov  test  for  some  selected 
distributions. 

5)  To  modify  the  Anderson-Darling  and  Cram£r-von-Mises 
goodness-of-f it  tests  in  a  manner  similar  to  the  one  pre¬ 
sented  in  this  thesis  for  the  K-S  test.  The  result  of 
the  three  modified  tests  can  then  be  compared  to  determine 
which  is  most  powerful. 

6)  To  conduct  the  power  of  the  test  for  the  Gamma  with 
3,000  samples  to  see  if  the  results  could  be  improved  with 
a  reduction  in  the  Monte  Carlo  variability. 
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Table  IX.  Shape  Parameter  Equal  to  1.5 
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Table  XII.  Shape  Parameter  Equal  to  3.0 
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Table  XIII.  Shape  Parameter  Equal  to  3.5 


Table  XIV.  Shape  Parameter  Equal  to  4.0 
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Appendix  B 


Tables  for  the  Weibull  Distribution 
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Table  XVI,  Shape  Parameter  Equal  to  1.0 
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Table  XXI.  Shape  Parameter  Equal  to  3.5 
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Table  XXIII.  Shape  Parameter  Equal  to  1.0  (5,000) 
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Appendix  C 


Plots  for  the  Relationship  between 
Shape  Parameters  and  Critical  Values 
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Figure  3.  Gamma  Level=.20  N=5 
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Figure  7.  Gamma  Level*. 15  N=15 
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Figure  10.  Gamma  Level®. 10  N=15 
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Figure  11.  Gamma  Level®. 10  N*30 
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Figure  12.  Gamma  Level-. 05  N-5 
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Figure  13.  Gamma  Level=.05  N=15 
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Figure  15.  Gamma  Level=.01  N=5 
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Figure  17.  Gamma  Level=.01  N=30 
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Figure  22.  Weibull  Level*. 15  N=15 
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Figure  24.  Weibull  Level®. 10  N®5 
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